Papers by Van Dai Do
Sample Efficient Alignment Learning With Episodic Control (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing parametric methods for aligning large language models with task objectives are limited. |
| Approach: | They propose a non-parametric framework that aligns large language models with task objectives . they use a key-value memory to store associations between generated text and its corresponding values . |
| Outcome: | The proposed framework outperforms state-of-the-art baselines on harmless, helpful, and summarization tasks. |
SPaCe: Unlocking Sample-Efficient Large Language Models Training With Self-Pace Curriculum Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing training pipelines sample training examples uniformly across steps or epochs, ignoring differences in difficulty, redundancy, and learning value, which slows learning and wastes computation. |
| Approach: | They propose a self-paced learning framework that enables efficient learning based on the capability of the model being trained through optimizing which data to use and when. |
| Outcome: | The proposed framework achieves comparable or better accuracy than state-of-the-art baselines while using up to (100 times) fewer samples. |
Dynamic Steering With Episodic Memory For Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing activation steering methods apply a single sentence-level steering vector uniformly across all tokens, ignoring LLMs’ token-wise, auto-regressive nature. |
| Approach: | They propose a framework that aligns LLMs to given demonstrations by steering at the token level conditioned on the input query. |
| Outcome: | The proposed framework surpasses baselines across safety, style transfer, and role-playing tasks, demonstrating improved alignment as demonstration scales. |